Adapting Multimodal Fission to User's Abilities
نویسندگان
چکیده
New ways of communication are now possible thanks to adaptive multimodal systems, enabling the improvement in accessibility of ICT applications to all users. We are developing a project which combines TV with a multimodal system in order to overcome accessibility and usability problems by impaired users. This paper is focused on the fission of outputs, and how the presentations of applications running on GUIDE’s environment are adapted to the user’s capabilities.
منابع مشابه
Towards Symmetric Multimodality: Fusion and Fission of Speech, Gesture, and Facial Expression
We introduce the notion of symmetric multimodality for dialogue systems in which all input modes (eg. speech, gesture, facial expression) are also available for output, and vice versa. A dialogue system with symmetric multimodality must not only understand and represent the user's multimodal input, but also its own multimodal output. We present the SmartKom system, that provides full symmetric ...
متن کاملAdapting Tv Based Applications’ User Interface
In this paper we describe the design and implementation of an adaptive multimodal fission component integrated in the multimodal GUIDE framework. This component is able to adapt any TV based application’s UI to a specific user’s characteristics making possible for elderly and impaired users to interact by offering several output modalities that tries to overcome his difficulties of interaction.
متن کاملMAUI avatars: Mirroring the user's sensed emotions via expressive multi-ethnic facial avatars
2 Abstract— In this paper we describe the Multimodal Affective User Interface (MAUI) we created to capture its users' emotional physiological signals via wearable computers and visualize the categorized signals in terms of recognized emotion. MAUI aims at 1) giving feedback to the users about their emotional states via various modalities (e.g. mirroring the user's facial expressions and describ...
متن کاملAdaptation to the User's Task
Adapting explanations to users with varying background knowledge and abilities is a difficult task: the explanation content, style, amount of details, terms used, etc. may be affected in various ways. We have used our analysis of the information seeking tasks of the users in one particular domain as a basis for adaptation. We structured the domain information into a set of information entities ...
متن کاملMultimodal Interfaces - A Generic Design Approach
Integrating new input-output modalities, such as speech, gaze, gestures, haptics, etc., in user interfaces is currently considered as a significant potential contribution to implementing the concept of Universal Access (UA) in the Information Society; see (Oviatt, 2003), for instance. UA in this context means providing everybody, including handicapped users, with easy human-computer interaction...
متن کامل